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Abstract 

This paper describes a minimax state estimation approach for linear Differential- Algebraic Equations (DAE) with uncertain 
parameters. The approach addresses continuous-time DAE with non-stationary rectangular matrices and uncertain bounded 
deterministic input. An observation's noise is supposed to be random with zero mean and unknown bounded correlation 
function. Main results are a Generalized Kalman Duality (GKD) principle and sub-optimal minimax state estimation algorithm. 
GKD is derived by means of Young-Fenhel duality theorem. GKD proves that the minimax estimate coincides with a solution 
to a Dual Control Problem (DCP) with DAE constraints. The latter is ill-posed and, therefore, the DCP is solved by means 
of Tikhonov regularization approach resulting a sub-optimal state estimation algorithm in the form of filter. We illustrate the 
approach by an synthetic example and we discuss connections with impulse-observability. 

Key words: Minimax; Robust estimation; Descriptor systems; Time-varying systems; Optimization under uncertainties; 

Tikhonov regularization. 
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1 Introduction 

This paper presents a generalization of the mini- 
max state estimation approach to linear Differential- 
Algebraic Equations (DAE) in the form 



d{Fx) 
dt 



C{t)x{t) + J{t), Fxito)^xo (1) 



where F E ^rnxn jg ^^ rectangular m x n-matrix and 
t I— > C{t) e jjmxn ig a continuous matrix-valued func- 
tion. The research presented here may be thought of 
as a continuation of the paper [Zhuk, 2010], where the 
case of discrete time DAEs with time-depending coef- 
ficients was investigated. We stress that the DAE with 
F S M™^" is non-causal (the matrix pencil F — XC{t) is 
singular [Gantmacher, I960]) ii m y^ n. Also the coeffi- 
cient C(t) depends on time. Therefore the state estima- 
tion problem for DAE in the form (1) can not be directly 
addressed by parameter estimation methods (see for 
instance [Gerdin et al., 2007], [Darouach et al., 1997] 
and citations there), based on the transformation of 
the regular matrix pencil F — XC (det {F — AC) ^ 0) 
to the Weierstrass canonical form [Gantmacher, I960]. 
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As it was mentioned in [Gerdin et al., 2007], the latter 
transformation allows to convert DAE (with regular 
pencil) into Ordinary Differential Equation (ODE), 
provided the unknown input / is smooth enough and 
C(t) = const. On the other hand, in applications / is 
often modelled as a realization of some random process 
or as a measurable squared-integrable function with 
bounded L2-norm. One way to go is to take Sobolev- 
Shvartz derivative of /, allowing the state x{t) of DAE 
to be discontinuous function. If the latter is not accept- 
able, it is natural to ask if it is possible to derive a state 
estimation algorithm for DAE (in the form (1)) avoiding 
the differentiation of the unknown input /. More gener- 
ally, is it possible to derive a state estimation algorithm 
for DAE in the form (1) with measurable / without 
transforming the pencil F — XC into a canonical form? 
The same question arises if C{t) is not constant as in 
this case it may be impossible (see [Campbell, 1987]) to 
transform DAE to ODE even if the pencil F — XC{t) 
is regular for all t. In this paper we give a positive an- 
swer to this question for the following state estimation 
problem: given observations y{t)^ t € [to,T] of x(i), to 
reconstruct Fx{T), provided a; is a weak solution to (1). 
We note, that many authors (see [Gerdin et al., 2007], 
[Darouach et al., 1997] and citations there) assume the 
state vector x{t) of (1) to be a differentiable (in the 
classical sense) function. In contrast, we only assume 
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that 1 1-> Fx{t) is an absolutely continuous function. In 
this setting x{T) is not necessary well defined. Hence, 
it makes sense to estimate Fx{T) only. In what follows, 
we assume that / is an unknown squared-integrable 
function, which belongs to a given bounded set ^. We 
will also assume that observations y{t) may be incom- 
plete and noisy, that is y{t) = H{t)x{t) + rj{t), where -q 
is a realization of a random process with zero mean and 
unknown but bounded correlation function. Following 
[Nakoncchny, 1978] we will be looking for the minimax 

estimate t{x) of a linear function ^ £{x) := {£, Fx{T)) 
among all linear functions of observations u{y). Main 
notions of deterministic minimax state estimation ap- 
proach [Milanese and Tempo, 1985,Chernousko, 1994], 
[Kurzhanski and Valyi, 1997] are reachability set, min- 
imax estimate and worst-case error. By definition, 
reachability set contains all states of the model which 
are consistent with observed data and uncertainty de- 
scription. Given a point P within the reachability set 
one defines a worst-case error as the maximal distance 
between P and other points of the reachability set. 
Then the minimax estimate of the state is defined as a 
point minimizing the worst-case error (a Tchebysheff 
center of the reachability set). In this paper we deal 
with random noise in observations. This prevents us 
from describing the reachability set. Instead, we derive 
a dynamic mean-squared minimax estimate minimizing 
mean-squared worst-case error. 

The contributions of this paper are a Generalized 
Kalman Duality (GKD) and sub-optimal minimax es- 
timation algorithm, both for DAE in the form (1). 
As it was previously noted in [Gerdin et al., 2007] 
the need to differentiate an unknown input posed a 
problem of mathematical justification of the filtering 
framework based on DAE with classical derivatives. In 
[Gerdin et al., 2007] the authors propose a solution, pro- 
vided det(i^ - AC) 7^ for any A [Gerdin et al., 2007]. 
Here we apply GKD in order to justify the minimax 
filtering framework for the case of DAEs (1) with any 
rectangular F and time- varying C{t). We do not use 
the theory of matrix pencils so that the condition of 
differentiability of the unknown input / in (1) is not 
necessary for our derivations. Applying GKD we ar- 
rive to the Dual Control Problem (DCP) with DAE 
constraint, which has a unique absolutely continuous 
solution, provided d belongs to the minimax observable 
subspace C{T). Otherwise, the solution of DCP is rep- 
resented in terms of the impulsive control. In this sense 
the minimax observable subspace generalizes impulse 
observability condition (see [Gerdin et al., 2007]) to the 
case of DAE with rectangular time- varying coefficients. 



^ Note that in order to reconstruct Fx{T) it is enough to 
reconstruct a linear function £{x) :— {£,Fx{T)) for any £ £ 
R*". Having the estimate of £{x) for any £ G K"*, one can 
set £ := ei = (0, . . . , 1, . . . 0)"^ in order to reconstruct i-th 
component of Fx{T). 



The cost function of DCP describes the mean-squared 
worst-case error and its minimizer represents a mini- 
max estimate. However, Pontryagin Maximum Princi- 
ple (PMP) can not be applied directly to solve DCP: 
a straightforward application of the PMP to the dual 
problem could reduce the minimax observable subspace 
to the trivial case /1{T) = {0} (see example in Subsec- 
tion 2.2). In order to preserve the structure of C{T) we 
apply Tikhonov regularization approach. As a result 
(Proposition 4) we represent a sub-optimal minimax 
state estimation algorithm as a unique solution of a 
well-posed Eulcr-Lagrange system with a small param- 
eter. This solution converges to the minimax estimate. 
We represent the sub-optimal estimate in the classi- 
cal sequential form: as a solution to a Cauchy problem 
for a linear stochastic ODE, driven by a realization of 
observations y{t), t € [to,T]. We recall that y{t) is per- 
turbed by a "random noise" , which can be a realization 
of any random process (not necessary Gaussian as in 
[Gerdin et al., 2007]) with zero mean and unknown but 
bounded correlation function. 

This paper is organized as follows. At the beginning 
of section 2 we describe the formal problem statement 
and introduce definitions of the minimax mean-squared 
estimates and errors. The rest of this section consists 
of two subsections. Subsection 2.1 presents the GKD 
(Theorem 2). In subsection 2.2 we discuss optimality 
conditions and derive regularization scheme (Proposi- 
tion 4) along with the representation of the sub-optimal 
minimax estimate in the sequential form (Corollary 5). 
Also we present an example. Section 3 contains conclu- 
sion. Appendix contains proofs of technical statements. 
Notation: Erj denotes the mean of the random ele- 
ment rj; int G denotes the interior of G; M" denotes the 
n-dimensional Euclidean space; h2{to,T,M.™) denotes 
a space of squarc-intcgrable functions with values in 
M™ (in what follows we will often write L2 referring 
h2{to,T,'R'') where the dimension k will be defined 
by the context); Ili{to,T,R"^) denotes a space of ab- 
solutely continuous functions with L2-derivative and 
values in M™; the prime ' denotes the operation of tak- 
ing the adjoint: L' denotes adjoint operator, F' denotes 
the transposed matrix; c{G, •) denotes the support func- 
tion of a set G; (•,•) denotes the inner product in a 
Hilbert space H, ||a;]|^ :— {x,x), \\ • \\ denotes norm in 
M"; S* > means {Sx,x) > for all x; i^+ denotes 
the pseudoinverse matrix; Qi denotes the square-root 
of the symmetric non- negative matrix Q, /„ denotes 
n X n-identity matrix, 0„xm denotes n x m-zero matrix, 
/q := 0; tr denotes the trace of the matrix. 

2 Linear minimax estimation for DAE 

Consider a pair of systems 
d{Fx) 



dt 



= C{t)x{t) + fit) , Fx{to) - xo ., 



y{t)^H{t)x{t)+i^{t), 



(2) 
(3) 



where x{t) e M", /(i) e M™, y(t) e Rp, 7]{t) e Rp 
represent the state, input, observation and observation's 
noise respectively. As above, we assume F € M™^", 
/ G h2{to,T,E."'), and C(f) and H{t) are continuous ^ 
matrix- valued functions of t on [to,T],to,T £ M. Now let 
us describe our assumptions on uncertain xq, /, r/. Let 77 
be a realization of a random process such that Erj{t) — 
on [to,T] and 7^^(t,s) := £;i'(t)^'(s) is bounded: 



7e^ e VK = {7^,, 



tr(i^(f)7^^(i,t))c^i< 1} (4) 



We note that the assumption Eri(t) = is not restrictive. 
If Eri{t) = r](t) y^ where f]{t) is a known measurable 
function then we can consider new measurements y{t) :— 
y(t) — rj{t) and new noise ri{t) — fi{t). 
The initial condition xq and input / are supposed to 
belong to the following set 



^ := {(xo,/) : {QoXo,xo) + / {Q{t)f,f)dt < 1}, (5) 

Jta 

where Qo,Q(t) e M"><™, Qo ^ Q'o > 0, Q = Q' > 0, 
R{t) G MP^P, i?' = i? > 0; Q{t),R{t), R-\t) and Q-i(t) 
are continuous functions of i on [Iq, T]. 

Definition 1 GivenT < +oo,u e h2{to,T,W) audi € 
M™ define a mean-squared worst-case estimation error 

a{T, e, u) := sup E[{£, Fx{T)) - u{y)]^ 

x,ixo, f)ew,n^ew 

A function u{y) = J^ {u{t),y{t))dt is called an a pri- 
ori minimax mean-squared estimate in the direction i 
(f.- estimate) if miuO'{T,£,u) = a{T,£,u). The number 
a{T,£) = a{T,£,u) is called a minimax mean-squared a 
priori error in the direction £ at time-instantT (£-error). 
The set L{T) = {^ e M" : cf{T,£) < +00} is called a 
minimax observable subspace. 

2. 1 Generalized Kalman Duality Principle 

Definition 1 reflects the procedure of deriving the min- 
imax estimation. The first step is, given £ and u to cal- 
culate the worst-case error a{T,£,u) by means of the 
suitable duality concept. 

Theorem 2 (Generalized Kalman duality) Take 
e G M". The £- error a{T, £) is finite iff 



djF'z) 
dt 



-C'{t)z(t) + H'{t)u{t), F'z(T) = F'£ (6) 



^ Slightly modifying the proofs we can allow C{t) and H{t) 
to be just measurable. 



for some z eL2(0,r,M'") and m e L2(0, r,MP). 
Ifa{T,£) < +00 then 



a{TJ., u) = mm{\\Q„-'{zito) - v{to)) - Q„ ^ d\\^ 

v.d 

r-T .T 

+ / \\Q-'^{z-v)fdt}+ / \\R-^^ufdt 



\\Q-Hzito)^v{to))-Qo^df 



(7) 



\\Q-Hz-vW + \\R--^u\\^dt 



to 



where Qq ^ = Qq ^ F' F' , min in (7) is taken over all d 
such that F' d = and all v verifying (6) with u ~ Q and 
£ = 0, and min is attained at v, d. 

Remark 3 An obvious corollary of Theorem 2 is an ex- 
pression for the minimax observable subspace 

C{T) = {£ e M™ : (6) holds for some z, u} (8) 

In the case of stationary C{t) and H{t) the minimax 
observable subspace may be calculated explicitly, using 
the canonical Kronecker form [Gantmacher, li 



PROOF. Take ^ e E" and u e l^2{to.T,W). Using 
Erj{t) = we compute 

E[£{x) - u{y)]^ ^E[f {u, ri)dtf{:^ 7^) 
+ {{£,Fx{T))- [ {H'u,x)dt)\:^ f,^) 

Jto 

Let us transform ^'^. There exists w € 'L2{to,T,M."^) 
such that: (W) F'w G M\to,T,W^) and F'w{T) = F'£. 
Noting that [Albert, 1972] F = FF+F we have 

{£,Fx{T)) == {F'£,F+Fx{T)) ^ {F'w{T),F+Fx{T)) . 

The latter equality, an integration-by-parts formula 

{F'w{T),F+Fx{T)) - {F'w{to),F+Fx{to)) = 

'^ ,d{Fx) ^ ,d{F'w) ^ , (10) 

\w) + {^—^,x)dt. 



to 



dt 



dt 



(proved in [Zhuk, 2007] for Fx e W^{to,T,W^) and 
F'w e Hi(io,T,M")) and (2) gives that 



ti^{{F+yF'w{to),Fxo)+ {f,w)dt 

Jto Q^N 



to 



dt 



+ C'w- H'u,x)dt. 



By (9) and (11): <j{T, £, u) = sup^^^ 7' +supy;,„^. A*'- By 

Cauchy inequality 7^ < /^ E {Rrj , -q) dt J^ {R^^u,u)dt. 
As E{R'q, rf) = tr (i?7^^), it follows from (4) 



a{T,£,u)^ / {R-^u,u)dt+ sup /x^ (12) 

J to f\xo,x 

Assume a{T, £) < +00. Then (t{T, £,u) < 00 for at least 
one u so that sup/ x x P'^ ^ °°- The term J (/, w)(ii in 
the first line of (11) is bounded due to (5). Thus 



suv{{F'w{t^),F+Fx{to)) 

X 



to 



dt 



+ C'w - H'u, x)dt} < 00 



(13) 



where sup is taken over all x solving (2) with {xq, f) G ^. 
(13) allows us to prove that there exists z such that (6) 
holds for the given £ and u. To do so we apply a general 
duality result ^ from [Zhuk, 2009]: 

sn-p {{T,x),LxeG}^ inf {c{G , b) , L' b ^ T} 

xe^(L) beS>(L') 

(14) 
provided (Al) L : &{L) C "Hi ^ H2 is a closed 
dense-defined linear mapping, (A2) G C H2 is a. closed 
bounded convex set and "Hi, 2 are abstract Hilbert 
spaces. Define 

{Lxm = (^ - C(t)x(t), Fxito)), X e ^(L) ^^g^ 
^{L) :== {x:Fxe Hi(io,r,K")} 

Then L is a closed dense defined linear mapping 
[Zhuk, 2007] and 

{L'b){t) = -^^-C'z,be^iL'), 
^{L') :={6=(z,zo) :F'zeHi(to,r,M'"), (1^) 
F'z{T) = 0, zo = F+'F'z{to) + d, F'd = 0} 

Setting T := ((F+)'F'w;(io), ^i^M + C'w ~ H'u) we 

see from (13) that the right-hand part of (14) is finite. 

Hence, there exists at least one 6 € 2i{L') such that 

/ / XX d(F'z) ^, d(F'w) 

L'b = J^ or (using (16)) ^—^ - C' z - ^ ' ' 



dt 



dt 
d(F'z) 
C'w — H'u. Setting z :— {w + z) we obtain 



dt 

C'l - H'u ^ and F'z = F'£. This proves (6) has a 
solution. 
On the contrary, let z verify (6) for the given £ and u. 



Then z verifies conditions (W), therefore we can plug z 
into (11) instead of w. Define'' Gi := ^ n TZ{L), where 
7^(L) is the range of the linear mapping L defined by (15) 

and set S := sup^xoj)eGi{P' ^ito), F+xq) + J^^ {z,.f)dt. 
Now, using (12) one derives easily 



aiT,£,u) 



(R-^u,u)dt + S^ 



(17) 



to 



Since Gi is bounded, it follows that a{T,£,u) is finite. 
Let us prove (7). Note that 5 is a value of the support 
function of the set Gi = ^ n 7^(L) on {F'^F'z{to), z). 
To compute S we note that L, ^ verify (Al), (A2) and 
intGi ^ 0. Thus (see [Zhuk, 2009]): 

S^ min {c(G,F'+i^'z(to)-2o,z-w)} (18) 

(2;o.2;)eAf(L') 

and the min in (18) is attained on some (zq, z) G N{L'). 
Recalling the definition of V (formula (16)) and noting 

that c2(G,z- 6) = ||Oo^(F'+^'(z(to)-t'(io))-d)||' + 
/tl \\Q~^{z - ^Wdt we derive (7) from (17)-(18). This 
completes the proof. 



2.2 Optimality conditions 

Assume £ G C{T) . By definition 1 and due to Generalized 
Kalman Duality (GKD) principle (see Theorem 2) the 
^-estimate u is a solution of the Dual Control Problem 
(DCP), that is the optimal control problem with cost (7) 
and DAE constraint (6) for any constant F £ jjmx" 
and continuous t ^ C{t) £ M™^", t £ [to,T]. If i^ = 
Inxn then u — RHp where p may be found from the 
following optimality conditions (Euler-Lagrange System 
in the Hamilton form [loffe and Tikhomirov, 1974]): 



dFp 

dF'z 
dt 



= Cp + Q-^z, Fp{tn) ^ Qnz{tn), 
= -C'z + H'RHp, F'z{T) = F'£ . 



(19) 



with Qo = Qo^F'+F'. In the general case F e M"^", 
let us assume that (AS) the system (19) is solvable. 
One can prove using direct variational method (see 
[loffe and Tikhomirov, 1974])) that ii = RHp solves the 
DCP with cost (7) and DAE constraint (6). Although 
the assumption (AS) allows one to solve the optimal 
control problem with DAE constraints, it may be very 
restrictive for state estimation problems. To illustrate 
this, let us consider an example. Define 



F' = 



ri 


01 


(1 


1 


(1 





Lo 


oj 



,G'(t) = 



ro 


-i"l 



1 





-1 



,H'{t) = 



ri 


n 


"1 


(1 


(1 


1 


(1 


(1 





Lu 


1 


0} 



(20) 



^ The proof of (14) for bounded L and Banach spaces ^1,2 
can be found in [loffe and Tikhomirov, 1974] 



'^ Gi is a set of all xq, f such that {xo, /) G ^ and (2) has 
a solution x. 



and take Qo = Q{t) = I2x2, R{t) = I4x4- In this 
case (19) reads as: 



dzi 
~dt 

dZ2 

~dt 
dp 

In 

dp2 
dt 



= Z2 +Pl,Zl{T) = il,-Zl = 0, 
= P2,Z2{T) = £2,Z2 +P4 = 0, 

r = P3 + 2i,pi(to) = zi{to), 

-Pl -Pi + Z2,P2(to) = Z2{to) 



(21) 



We claim that (21) has a solution iff £i = ^2 = 0. Really, 
Zi{t) = implies Zi{T) = ^1 = 0, — Z2 = Pi ~ P4 and 
4iPi = Ps- According to this we rewrite (21) as follows: 



dpi 

dt 
dp2 
dt 



= -P2,pi(io) = o,pi(r) = £2, 

= -3pi,p2(to) = 0. 



(22) 



It is clear that (22) has a solution 15^2 — 0. Thus, the as- 
sumption (AS) leads to the trivial minimax observability 
subspace: £{T) = {0} x {0}. However, £(T) = {0} x M. 
To see this, take u^ G h2, £2 ^ ^ and £1 ~ 0, and de- 
fine zi ~ 0, ui^2 — ^Z2, Z2 = £-2 ^ L U3{s)ds. By direct 
substitution one checks that zi^2 and ui,2,3 solve (6). 
Therefore C{T) = {0} x M due to (8). We see that classi- 
cal optimality condition (Euler-Lagrange system in the 
form (19)) may be inefficient for solving the minimax 
state estimation problems for DAEs. In the next proposi- 
tion we prove that optimal control problem with cost (7) 
and DAE constraint (6) has a unique solution u, z, pro- 
vided £ S 'C(T), and we present one possible approxima- 
tion of M, z based on the Tikhonov regularization method 
[Tikhonov and Arsenin, 1977]. 

Proposition 4 (optimality conditions) Let e > 0. 

The DAE boundary-value problem 



^-C'z + H'u + p, 
= Cp + eQ^^z, eii = RHp, 



d{F'z) 

dt 
d{Fp) 

— — — — \^p -r c^; /.^ cLL — imp, /^„s 

F'z{T) + F+Fp{T) = F'£, F'd = 0, 
-^Fp{to) ^ Q^\F'+ F' z{to) - d) . 

has a unique solution Ug, Ps, z^, de- If £ ^ ^{T) then 
there exists d, u and z such that 1) d,^ ^f d in M" and 
Ug -^ u, Zg —^ z in L2, 2) u and z verify (6) and 3) u is 
the £-estimate and £-error is given by 



a{T,£) = a{TJ.,u) = n{u,z,d) := \\R--^u\\? 



+ \\Q,HF'^F'z{to)-d)r + \\Q-^z\\l 



(24) 



PROOF. Define r := rangF and D = diag(Ai . . . A^) 
where Ai, i — l,r are positive eigen values of FF'. If 
r = then (23) is obviously uniquely solvable. Assume 
r > 0. It is easy to see, applying the SVD decomposition 
[Albert, 1972] to F, that F = U'SV, where UU' = /„, 

V'V == /„ and 5 = [ ^* o-x^-. 1 . Thus muffiply- 

ing the first equation of (23) by U, the second - by V, and 
changing variables one can reduce the general case to the 



case of DAE (23) with F 



Or> 



. In what 



follows, therefore, we can focus on this case only. Hav- 
ing in mind the above 4-block representation for F we 
split the coefficients of (23) as follows: C{t) 

" Ql Ql' 

.(Q2)' Ql. 
n — r 



Q = 



io = 



rci 


C,] 


LCa 


C4J 


S^ 


S2 


[S'2 


Si 



^ = (.0'^=(^0-ifi) 



H'RH = 

and 771 — r > we set 
C2 := Orxi, Ci :— Om-rxi and 6*2 := O^xi, 5*4 := 0; if 2) 
n — r > and TO— r — Owe set C3 :— Oixr, C4 :~ Oixn-r 
and Q2,Q2 ■= Omxi, Q4,Q4 := 0; if 3) n = TO = r we 
set C4 := 0, C2 ■■= Orxi, C3 := Oixr and let Si, Q",Qt 
be defined as in 1) and 2) respectively, i € {2,4}. Ac- 
cording to this (23) splits into 



dp 



dt 

dzi 



- = Cipi + C2P2 + £{QiZi + Q2Z2) 



= -C[zi - C3Z2 +pi + -{Sipi + S2P2), 



ziiT) +pi{T) = £i,piito) = £(Q;zi(to) - Q2d2) 
and algebraic part: Q'^d2 = (Q2)'-^i(^o)7 



C3P1 + C4P2 + e{Q2Zi + Q4Z2) = 0, 

- C^Zi - C'iZ2 + -S'^Pl + (I+ -S4)P2 

e e 



0. 



Define Qi := Q? - Ql{Ql)-^{Ql)' and set 

W{t,e) = ein-r + Si + C'^Q^^Ci,M{t,e) = W-\t,e) , 
A{t) - (C^gr'C4 + ^2), Bit) - {C'2 - C',Q^'Q'2) , 
C,{t) = -C; + C^Q4 ig^ + Ait)Mit, e)B{t) , 

Qe{t) = --^A{t)M{t, e)A'{t) + /, + i[^i + C'^Ql^C^] , 

Se{t) = £(Qi - Q20r'Q2 + B'{t)M{t,e)B{t)) . 

Solving the algebraic equations for Z2,P2jC?2 wc find: 

Q4Z2 = {-Q'2 - C4MB)zi + -{C4MA' - C3)pu ,^^. 

e (25) 

P2 = eMBzi - MA'pi,d2 = (02)"'(Q2)'^i(io)- 

Substituting (25) into differential equations for pi , z\ we 
obtain 



dz\ 

~dt 
dpi 
dt 



C,zi + Q,pi,zi(T)+piiT)=£i, 
■ -C'^pi + SeZi,pi(to) = eQ4Zi(to). 



(26) 



We claim that (26) has a unique solution for any £i E MJ" 
and e > 0. Let us prove uniqueness. Note that Qi — 
Q2Qi^Q'2 > as Q(t) > (see [Albert, 1972] for de- 
tails) and thus Se{t) > for e > (as B'MB > 0). Ap- 
plying simple matrix manipulations one can prove (see, 
for instance, [Kurina, 1986]) that Qe{t) > for e > 0. 
Assume zi,pi solve (26) for ii = 0. Then, integrating 
by parts and using (26) we obtain 

-(zi(r),zi(T)) - (zi(to),eQ42i(io)) 

i-T 

{QsPl,Pl) + {SeZi,Zi)dt 
'to 

This equality is possible only if pi ~ 0, zi ^ as 
Se{t),Qe{t) > 0. As (26) is a Noether Boundary- 
Value Problem (BVP), which has a unique solution for 
£i = 0, it follows from the general theory of linear BVP 
[Boichuk and Samoilenko, 2004] that (26) has a unique 
solution for any £i. Thus, we proved unique solvability 
of (23). Let us introduce the following definitions. Take 
u G L2 and z G L2 such that F'z e Hi, and assign to 
u,z a, number 6{u, z): 

dF' 7 
S{u, z) := llF'z(T) - F'if + || ^_ + C'z - H'u\\l^ 

It was proved in [Zhuk, 2007] that 5 is convex and weakly 
low semi-continuous ^ (w.l.s.c). Define a Tikhonov func- 
tion Te{u, z, d) := S{u, z)+efl{u, z, d) with J7(u, z, d) de- 
fined by (24). We claim (see appendix for the details) 
that 

Te{ui.,Zs,di;) ^ ini %{u,z,d) -.^T*, Ve > (27) 

u^z.d 

Take any £ G ^{T). By (8) there exists u and z such that 
inf (5 = S{u, z) = 0. Using (27) we obtain 



We claim that (see appendix for technical details) 



ri{u^ z, d) < lim fl{ue, Zg, d^) 



(31) 



By (31) and (29) we get: 



n(u,z,d)^n* -.^ inf n(u,z,d) (32) 

{{u,z):S{u,z)=0},F'd=0 

Note that fi is strictly convex, therefore J7 has a 
unique minimizer w* , which coincides with {u,z,d) 
by (32). This proves that w* is a unique weak limit- 
ing point for the bounded sequence {ue,Ze,di.}. Thus, 
{de} converges to d in M" as in M" the weak conver- 
gence is equivalent to the strong convergence. More- 
over, (31) and (29) implies lim S7(ue,Ze,(i£) = Q.{u,z,d). 
The latter proves 1) as {Me,Ze} converges to (u, ^) 
in L2 if and only if {u^,Zg} converges to (u, £) 
weakly and lim||u,||2^ + \\ze\\l^ = \\u\\l^ + \\z\\l^ 
(see [loffe and Tikhomirov, 1974] for details). 2) also 
holds as S{u,z) = by (30). Let us prove 3). Take 
any u, z verifying (6) and v,d defined by (7). Define 
z := z — V. Using the definition of v (see (7) and 
notes after it) we find that z also solves (6). Thus, 
a{T,£,u) = n{u,z,d) > n{u,zj) by (32). Hence, 
^■(T, £) > ^{ii, z, d). On the other hand, we get by 1): 

ct(T, £:) < cr{T, £, u) < min f7(u, z-v, d) 
< minjlim \\Q-^F+' F'z,{to) - F+' F'v{to) - l)\\^ 

V e— >0 

+ \in.^\\Q-Hze-v)r} + \\R-H\\l^ 

= limO(u,4,4)-Hmin{l|Qo^F+'F'w(io)|P + |K 
= fl{u,z, d) 



^IILI 



< 7;* < Te{u, z, d) < S{u^, Ze) + efliu, z, d) (28) 

for any d : F'd ^ 0. Due to (28): T* = S{u^,Ze) + 
efl{ue, -Ze, dg) < S{ue, z^) + £^{u, z, d) so that 

n{u,,Ze,de) <^{u,z,d), S{u,z) = 0,F'd = (29) 

(29) proves that {iig, z^,d^} is a bounded sequence in 
the Hilbert space L2 x L2 x M". Thus it contains a sub- 
sequence {wej. , Ze,, , de,, } which Converges weakly to some 

element u, z, d. By (28) = S{u, z) < (5(ue^ , Ze^) < T* < 
d{u, z) + eQ{u, z, d) so that by w.l.s.c. of 5: 

S{u, z) < lim d{ue^ 1 ^Ck) — "^("i ^) — i^f S ~ (30) 

fe— >-oo u,z 



where we obtained the 4th line noting that \\Q 2 (z^ 



"" that is S{u,z) < limS{un, z„), provided u„,z„ converges 
weakly to (m, «) or equally /^ {un,p) + {zn,q)dt ~^ J^ {u,p) + 
(2, q)dt for any (p, q) in L2 x L2. 



2Z, 



£|IL2 



Q-iv\\l^^2 J. {Q-'ze,v)dt a.nd 



{Q-'z,,v)dt^- f {^^Cp,,v)dt 
£ J to dt 

= -{Q^\F+'F'Uto)--l),F+'F'v{to)) 

where the latter equality follows from (10), def- 
inition of V (see notes after (7)) and (23). Thus 
a{T,£) < a{T,£,u) < fi,{u) = n{u,z,d) implying (24). 
(24) implies, in turn, it is the ^-estimate by definition. 
This completes the proof. 



We will refer u^ as a sub-optimal ^-estimate. Let us rep- 
resent Ue{y) ill the form of the minimax filter. Recalling 
definitions of M, A, B introduced at the beginning of the 
proof of Proposition 4, and splittings for £,Q,R,H,C we 



define $(t, e) 
solves 



K(t,s) 
M{t,e)[eB(t)-A'{t}K{t,s)] 



where K{t, e) Theorem 2 the exact ^-estimate u — ( «2 ) may be ob- 



dK 
lit 



-KCe - C'^K - KQ^K + Se, K{0) ^ eQi 



Define zi{T) = [U + K{T, e))-^(.i and let zi solve 
dzi 



dt 



CeZi+QeK{t,e)zi, 



(33) 



Define x^{ti^) = and let x^ solve the following linear 
stochastic differential equation: 

dx^ = [-C, - K{e, t)Q^]x^dt + ^H'Rdy, (34) 



Corollary 5 Assume -F = [ g. 



/, 0,x„- 



Then 



uM= / («e, 2;)rft =(£"'(/,. + i^(T,e))-ixaT),^i) 

"'to 

T/ie sub-optimal £-error is given by 



a%T,e):^-[{z^{T),z^{T)}- / ||$(t,£)zif di] 

£ "'to 



PROOF. Assume p^ solves (23). We split Pe = (pi) 
where pi solves (26) and P2 is defined by (25). It can be 
checked by direct calculation that pi{t) — K{t,e)zi{t) 
where zi is defined by (33). Using this and (25) we de- 
duce p^ = ^{t,e)zi. (23) implies ii^ = -RHp^. Finally, 
using the obtained representations for p^, ii^ and (34) 
we obtain integrating by parts that 

uM= I {y,-RHp,)dt^ I {-<P'H'Ry,zi)dt 

Jto £ ^to £ 



= {h,e-\lr + K{T,e))-H,{T))^ / {u,y)dt = u{y) 

Jta 

By (29)-(31) n{us,Ze,de) ^ ^(TJ). It is easy to com- 
pute using (23) that V,{us,z^,d^) — e^^{{i,Fps) + 
IIPeIIl )• To conclude it is sufficient to substitute 
Pe = '5{t,e)zi into the latter formula. 



Example. In order to demonstrate main benefits of 
Proposition 4 we will apply it to the example presented 
above: assume that the bounding set, state equation 
and observation operator are defined by (20) . Note that 
F'+F' = /4. Thus F'd = imphes d ^ 0. According to 



"3 

2 ii_ /, MI2 



tained minimizing (t(T, ^, m) ~ X]i=i ll-^i(^o)| 
J2i=i II'^jIIl '^'^'-'r solutions of the DAE 



dzi 

~dt 
dz2 
~dt 



Z2 - ui = 0, zi{T) = ii,~zi = 

U3 = 0, 22 (T) ^ (.2,-Z2 -U2=Q 



Z^\\L + 



(35) 



Assume ^i = so that I = {\D e C{T). If ui,2 
solves (35) then mi,2 = —Z2- Hence, u^ may be found 
minimizing a{T,£,u) — ||22(to)|P + L 3z| + u^dt 

dZ2 

~dt 



over 



M3, 22 (T) — (.2- The optimality condition takes 



the following form: U3 



^' dt 



p, Z2{T) = (.2, 



-^ = 3z2, p{to) — Z2{to)- Let us represent the estimate 
in the form of the minimax filter. Introducing fc as a so- 
lution of the Riccati equation ^ = fe^ — 3, k{0) = 1 we 
find that U2 = kz2 where Z2 solves the following Cauchy 
problem: ^ = kz2, Z2{T) — £2- Let a; be a solution to 
^ = —kx — yi — 2/2 + fcj/3, x{to) = 0. Then it is easy to 
see that u{y) = J^ {u,y)dt — £2x{T), where y = (2/2) 

denotes a realization of the random process represent- 
ing observed data. Let us compute the sub-optimal 
^-estimate. (34) reads as 



dt 



(S) = 



-(l+i)fel -(l+i)fe2 



d 
dt 



kA 



-(1 + 


T+i 



-(l+i)fe4 



(^2) 



rfe 



10 

1 



1 

rfci fc2 

L fco kA 



1^3 ;> U2(to), 



= {".) 



' fci fc2 

. ko ki 



1+e 








-d + j) 



fe2- 
^4 . 



fcl(to) fc2(to) 
fc2(to) '£4(10) 



- fi 0] 

— lo iJ 



Define (M 



( ^1 ) . Due to Corol- 



l + fei(T) fe2(T) 

fc2(T) l + fc4(T)_ 

lary 5 the sub-optimal i?-estimate may be represented 
as uM = !l{ue.v)dt = i((|),(:^SS))- If ^1 = 



then the sub-optimal £-error is given by ir^ (T, l) — 

\([l%] M?)] (|)' (|))- Take to = 0, r= 1 and as- 
sume that F and C are defined by (20). In the corre- 
sponding DAE 2:3.4 are free components. For simulations 
we choose 2:3 = cos(t) and X4 = sin(t), xi(0) — 0.1, 
^2(0) = —0.1, /i = /2 = 0. In order to generate artifi- 
cial observations y we take ri{t) ^ ( -0.2 ) . In Figure 1 

the optimal ^-estimate, sub-optimal ^-estimate and sub- 
optimal ^-error are presented, provided ^"1 = 0, £2 = 1- 
As C{t) = {0} X M we see that xi is not observable in the 
minimax sense. This can be explained as follows. The 
derivative X3 of a;i may be any element of L2. As we 
apply integration by parts formula in order to compute 
ct(T, £, u) (see (10)), the expression for ct(T, £, u) contains 




needs to solve the DCP, that is a linear-quadratic con- 
trol problem with DAE constraints. Application of the 
classical optimality conditions (Euler-Lagrange equa- 
tions) imposes additional constraints onto the minimax 
observability subspace C{T). To avoid this we apply a 
Tikhonov regularization approach allowing to construct 
sub-optimal solutions of DCP or, sub-optimal estimates. 
li £ E 'C(T) then the sequence of sub-optimal estimates 
converges to the ^-estimate which belongs to L2. Oth- 
erwise sub-optimal estimates weakly converge to the 
linear combination of delta-functions. The L2-norms of 
the sub-optimal ^-estimates grow infinitely in this case. 

Appendix. Let us prove (27). Integrating by parts 
(formulae (10)) one finds 



Fig. 1. Optimal ^-estimate u{y) (Dashed), sub-optimal 
^-estimate 'fie(j/) (Dotted) and error (T^{t, €) (DotDashed) and 
simulated x-2.{t) (Solid), t. = (0, 1)^, t G [0, 1], e = exp(-30). 

Jj x^zidt. Thus, a{T,(.,u) < +00 implies 21 (i) = for 
any i G [toj ^]) in particular zi{T) = ^^ = 0. In this case 
M G L2 and Ue — >■ u in L2 . If £1 f^ then the only can- 
didate for ui is the impulse control 5{T — t)ii switch- 
ing zi from to £1 at time-instant T. However, in this 
case the numerical sub-optimal £-error computed by the 
algorithm of Corollary 5 increases: a'^{l,£) ss 3 x 10^, 
provided ^1 = 1, ^2 = and e ~ exp(— 30). Let us illus- 

-1" 
trate this. Assume C'{t) — ^Pj^ g , where c(i) — 



r 


-l"| 





n 


c{t) 








-1 



for ti < i < T and c{t) > for to < i < h. Then (6) is 
solvable for any £: the solution is given by ui := ^ — Z2, 
U2 = ~Z2, zi{t) ^ 0, ta < t < ti and zi{t) = ^z^£ for 

<i < t < T. As ui = ^ - Z2, it follows that ||ui||l2 
goes to infinity if fi — ?► T. We stress that the limiting 
case ti = T with c{t) = 1 corresponds to C'{t) which is 
being considered in our example (see (20)). 

3 Conclusion 

The paper presents one way to generalize the mini- 
max state estimation approach for linear time-varying 
DAE (2) . The only restriction we impose here is that F 
does not depend on time. But our approach can be gen- 
eralized to the class of time- varying F{t) with constant 
(or piece-wise constant) rank by means of Lyapunov- 
Floke theorem. The main idea behind the generalization 
is the Generalized Kalman Duality (GKD) principle. 
GKD allows to formulate a Dual Control Problem 
(DCP) which gives an expression for the Worst-Case Er- 
ror (WCE). Due to GKD the WCE is finite if and only 
if Also GKD gives necessary and sufficient conditions 
(in the form of the minimax observable subspace) for 
the WCE finitencss. In order to compute ^-estimate one 



, dFp, 
' dt 



Cpe, z)dt 



^,„ dF'z ^, .^^ 

{Pe,^^+C'z)dt 



to ^^ J to 

+ {FMT),F'+F'ziT)) - {FMt,),F'+F'zito)) 
In particular 



' dt 



Cp,,z,)dt = {F'UT) - F'£,F'z,iT)) 



/ {p„p, + H'u,)dt 

Jtn 



- (Q^'iF'^F'zSo) - d,),F'^F'z,{to) - 4) 
Having this in mind it is straightforward to check that 

\\R-'^uf - \\R-U\\\' + WQ-hf - \\Q-h,fdt) 
{eRui;,u ~ ii^) + {eQzg^z — z^)dt = / {Hpi.,u ~ Us)dt 

Jto 



2./t, 



> 



;^-Cp„z)di- r{^~cp,,z,)dt 

to dt Jt^ dt 

'^ dF' 7 

{\\p,f-{p,,—-+C'z-H'u))dt 



to 



dt 



+ {FMT),F'+F'ziT)) - {Fp,ito),F'+F'z{to)) 
- {FUT),F'+F'z,{T)) + {FMto),F'+F'z,{to)) 

where we have applied the sub-gradient inequality 
[Rockafellar, 1970] to pass from the first line to the 
second line. Using this inequality, the definition of 7^ 
and (23) it is straightforward to check that 



%{u, z, d) - Teiue, 4,4) > WF'ziT) - F'£ + F+Fp,{T)f 
+ \\Q-'^F'+ F' z{to) - F'+F'z,{to) + I - d)||2 

f'^ ,dF'z 
+ / ' 

Jto 



dt 



C'z-H'u-p^fdt> 



Let us prove (31). We proved that Ue,ie converges 
weakly to u, z and {d^} — > d in M". As the norm in L2 
is weakly low semi-continuous, it follows that 

n{u„Z,Je)-\\QohF'^F'z,{to)-deW 

<n{u,zJ)-\\Q-^F'+F'z{to)-d)f 

Therefore it is sufficient to show that F'ze(io) -^ 

F'z{t„) in M". Noting that F'g(io) = F'q{T) - 

T dF'q 



we write 



\{F'z,{^)-F'z{t^),v)\<\\F'zAT)-F'z{T)\\x 

r^ .dF'z^ dF'z , ,., (.1) 



X 11^11 + I ( 



to 



dt 



dt 



,v)dt\ 



(30) implies \\F'z^{T) - F'z(T)|| -^ and 



dF' 7 

\\{—r^ + C"4 - -ff'uelli'dt < +00, Ve > (.2) 



to 



As Zg and u^ converge weakly, it follows that limjCzg — 

dF'z 
H'uA = C'z - H'u. This and (.2) implies { -} is 

, di. 
bounded. Therefore, the weak convergence of Zg gives: 

'•'^ ,dF'z 

/to 



lim / ( — -—^,v)dt 



¥0 



dt 



dt 



,v)dt,v eh2 (.3) 
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